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Abstract — Nested codes have been employed in a large number 
of communication applications as a specific case of superposition 
codes, for example to implement binning schemes in the presence 
of noise, in joint network-channel coding, or in physical-layer 
secrecy. Whereas nested lattice codes have been proposed recently 
for continuous-input channels, in this paper we focus on the 
construction of nested linear codes for joint channel-network 
coding problems based on algebraic protograph LDPC codes. In 
particular, over the past few years several constructions of codes 
have been proposed that are based on random lifts of suitably 
chosen base graphs. More recently, an algebraic analog of this 
approach was introduced using the theory of voltage graphs. In 
this paper we illustrate how these methods can be used in the 
construction of nested codes from algebraic lifts of graphs. 

I. Introduction 

Nested codes have been widely used to implement binning 
schemes based on coset codes in the presence of noise for 
numerous scenarios, for example for the noisy Wyner-Ziv 
problem |1] and the dual Gel'fand-Pinsker problem 121. In 
particular, for the case with continuous-input channels, binning 
schemes based on nested lattice codes have been proposed 
in [21 . Recently, in f4\ the authors consider discrete-input 
channels and present compound LDGM/LDPC constructions 
which are optimal under ML decoding. 

While nested codes in these contexts are related to joint 
source-channel coding problems, the class of algebraic nested 
codes we will address in this paper are defined based on 
a joint channel and network coding scenario. Such nested 
codes have been originally proposed in |5 | for the generalized 
broadcast relay problem, where a relay node broadcasts N 
packets to several destination nodes, which akeady know some 
of the packets a priori. A related concept was used in |6| 
in the context of two-way relaying. The idea is that instead 
of information words, codewords of different subcodes Ce, 
1 < £ < N, aie algebraically superimposed via a bitwise 
XOR. In contrast to nested codes for the joint source-channel 
coding scenario described above, here each subcode and any 
arbitrary combination of the subcodes is intended to form a 
good channel code. In particular, this also holds for the linear 
combination of all subcodes, the global code C. It has been 
shown in Q for a broadcast scenario with side information 
that such a construction is able to outperform a scheme based 
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on a separation of channel and network coding for non-ergodic 
discrete-input fading channels. In these applications we require 
the subcodes to be better in threshold and/or in error-floor than 
the global code. 

In this paper we focus on array-code type constructions lO, 
|9| and propose an algebraic design of nested linear codes 
based on protograph LDPC codes IfTOl . IfTTII . In particular, 
in lfT2l . ifTSl a lifting technique based on voltage graphs has 
been proposed which has been shown to provide a large girth 
of the code graph and thus a good error-floor performance. 
In contrast to previous approaches based on concatenated and 
random LDGM codes Q, lfT4ll and also to constructions based 
on random LDPC codes we show that the advantage of the 
above algebraic constructions in the error floor regime also 
carries over to the nested code setting. 

II. Preliminaries 

A. Nested codes 

Consider M different information vectors ii of length Kg, 
1= 1, . . . , M, which we want to encode jointly in such a way 
that each information vector is associated with a codeword 
from a different subcode. The overall codeword c is generated 
by multiplying the concatenation of all information vectors 
with a generator matrix G of the global code C according to 



G 



M 



' Gi ® Ga 



*M Gm , 
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where each of the subcodes Ci with generator Gi of rate Rg = 
Kg/N is associated with the corresponding information vector 
ie and © represents a bitwise XOR. The goal is now to find 
general systematic design strategies where the subcodes, any 
combination of subcodes, and the global code C have good 
threshold and/or error floor properties. 

For the sake of simplicity we focus on AI = 2 and the 
binary case in the following. Our aim is to design an LDPC 
code such that its generator matrix G satisfies ([T]i, where H G 
{0, iy^-^i-^2)>iN represents a corresponding parity check 
matrix. If G is not rank deficient, the null space of H of 
dimension {N — Ki — K2) contains the codewords © 
ifGi ©i^Gs. 



Likewise, the columns of the parity check matrices Hi, 
H2 associated with Gi, G2 each form a basis for their null 
spaces of dimensions (TV — Ki) and {N — K2), respectively. 
A necessary condition to prevent G from having a rank 
smaller than Ki + K2 is that Hi, H2 cannot have more than 
{N — Ki — K2) linear independent parity check equations 
in common. Based on these considerations, we propose the 
following design strategy. First, randomly generate a matrix 
M G {0,1}^^^ of full rank N, according to a given row 
and column degree distribution. This matrix is then partitioned 
into three submatrices 
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Next, the individual parity check matrices for the nested 
code are obtained as 
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Thus, both Hi and H2 are guaranteed to have a null space 
of dimensions {N — Ki) and {N ~ K2), respectively, and H 
has {N — Ki — K2) parity check equations that are satisfied 
by Ci and C2. 

Proposition 1. The nested code property in ([TJ holds also if 
M and thus one or more of the matrices H, Hi, and H2 are 
(row) rank deficient. For a rank deficit r of the check matrix 
H the rate loss for the global code C is given as Ai? < r/N. 

Proof: Denote the rank deficit for the matrices Mi, M2 
as ri > 0, r2 > 0, respectively. This means that Gi has 
now a rank of at least Ki + r + ri, and G2 a rank of at 
least K2 + r + r2, resp., which leads to an overall rank of 
at least Ki + K2 + r + ri + r2 for the generator matrix G. 
Since both subcodes have at most N — Ki — K2 — r check 
equations in common the row rank of G must not be smaller 
than Ki + K2 + r to ensure the nested code property which 
is satisfied for any ri > 0, r2 > 0. By setting R'l + R'2 ~ 
(Ki + K2 +r)/N where R'l and R'2 denote the new rates for 
the subcodes Ci and C2, a rate loss of AR < r/N for the 
code C is obtained. ■ 
Note that an extension of the above design strategy to M > 
2 can be obtained in a straightforward way by modifying the 
partitioning and construction of M in (|2]i. 

B. Voltage graphs 

An algebraic construction of specific covering spaces for 
graphs was introduced by Gross and Tucker in the 1970s ifTSl . 
For a graph Q — {Vg,Eg), a function a called an ordinary 
voltage assignment, maps the positively oriented edges to 
elements from a chosen finite group G, called the voltage 
group. Each edge in Q has a positive and negative orientation, 
and the negative orientation is assigned the inverse group 
element. The base graph Q is called an ordinary voltage graph. 
The values of a on the edges are called voltages. A new graph 
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Fig. 1. A permutation voltage graph Q is sliown on the left and its derived 
graph Q on the right, where G serves as a protograph for Q. The darker edges 
correspond to the connections between the clouds of vertices incident with 
the nontrivial labeled edges. 

Q", called the (right) derived graph, is a |G|-degree lift of Q 
and has vertex set x G and edge set E x G, where if {u, v) 
is a positively oriented edge in Q with voltage b, then {u, a) is 
connected to {v, ah) in C/". Alternatively, another construction 
takes the voltage group to be the symmetric group 5„ on n 
elements and has a map the positively-oriented edges of Q into 
Sn- This yields a permutation voltage graph. The permutation 
derived graph Q" is a degree n lift (instead of nl) with vertices 
V X {1, . . . , n} and edges E x {1, . . . , n}. If tt e S'„ is a 
permutation voltage on the edge e = (u, v) of G, then there 
is an edge from {u, i) to (v, 7r(i)) in Q" for i = 1,2, ... ,n. 
We will represent each vertex {v,i) and each edge (e, i) in 
the derived graph by Vi and e^, respectively. In both cases, the 
labeled base graph (i.e. voltage graph) algebraically determines 
a specific lift of the graph. Fig. [T] shows a permutation voltage 
graph Q — ii'2,3 with two nontrivial permutation voltages on 
its edges to the group ^3, and the corresponding degree 3 
permutation derived graph. 

Henceforth, derived (lifted) graphs will be denoted by Q 
since the voltage assignment a should be clear from context. 
In this paper we will focus on permutation voltage graphs for 
designing nested codes. 

III. Nested codes from protographs 

We now describe a simple method to construct nested 
codes from protographs in which the base Tanner graphs 
corresponding to small parity-check matrices Hi,H2, and H 
are lifted to obtain Tanner graphs with corresponding parity- 
check matrices Hi, H2, and H. The simplicity of our method 
is that it involves just one lifting of the base graph Qm 
corresponding to M. 

We start with a small bipartite base graph with n left 
vertices, denoted by the set L, and n right vertices, denoted 
by the set R. The matrix M is the incidence matrix of the 
graph Qm- The n left vertices are the variable nodes and the 
right nodes are the constraint nodes (parity-check nodes) of 
the base graph. We partition the set of right nodes R in 
into three disjoint subsets Si , S2 and T of sizes ki , k2 and 
n — ki — k2, respectively, i.e., 6*1 U T U ^2 = R. We define 
the base graphs for the matrices Mi,M2, and A/3 as follows: 

> Let Q denote the induced subgraph of T in Qi\i. Note that 
Q is a bipartite graph with n left vertices of L and (n — 
fci — ^2) vertices of T. The corresponding parity-check 
matrix of Q is A/3. Lifting Q hy a degree m lift gives the 



derived graph Q with corresponding parity-check matrix 
H for the code C. The size of H is m{n~ki — ^2) x mn. 

• Let Qi denote the induced subgraph of S'2 U T in Q^. 
Note that tJi is a bipartite graph with n left vertices of 
L and (n — fci) vertices of S'2 U T. The corresponding 
parity-check matrix of Qi is the matrix Hi. Lifting Qi 
by a degree m hft gives the derived graph Qi with cor- 
responding parity-check matrix Hi for the first subcode 
Ci. The size of Hi is m{n — ki) x mn. 

• Similarly, let Q2 denote the induced subgraph of SiUT 
in Qm- Note that Q2 is a bipartite graph with n left 
vertices of L and (n — /C2) vertices of 5*1 U T. The 
corresponding parity-check matrix of Q2 is the matrix _ff2- 
Lifting Q2 by a degree m lift gives the derived graph Q2 
with corresponding parity-check matrix H2 for the second 
subcode C2. The size of H2 is m(n — fc2) x mn. 

• The lifts of each of the three graphs Qi, Q2, G can be done 
simultaneously by simply lifting the base graph Qm by 
a degree m lift in an appropriate way. 

The blocklength of the lifted nested code is = nm and 
the dimensions of the lifted subcodes are Ki > kim and 
if 2 > k2m with equality if and only if Hi and H2 are not 
rank deficient. This construction approach can be extended 
to nested codes having more than two component codes in a 
straightforward way. 

With the method outlined above, the design problem of 
the nested codes reduces to finding a suitable assignment of 
permutations (or, more generally, group elements) to the edges 
of the base graph Qm. Using random permutations is one 
avenue, however, we are interested in permutations that are 
determined algebraically to obtain an algebraic construction. 

In the following we focus on irregular constructions since 
by starting from a regular {dy,dc) code C with variable 
node degree and check node degree dc the corresponding 
subcodes will be regular {dy + c, dc) codes with c > 0. 
For the binary-input AWGN channel this typically leads to 
subcodes with larger thresholds |16| than the code C, which 
is not desired. By using irregular constructions for the nested 
code we can keep a certain fraction of degree-two variable 
nodes in the code to improve the threshold, in particular for 
the subcodes. 

IV. Lifted nested codes using commuting 

PERMUTATIONS 

In our first construction we combine a variant of the 
algebraic construction of LDPC codes presented in ||9l with 
the lifting technique described in Section |III] to obtain a family 
of quasi-cyclic nested codes. For an integer to, the subset of 
integers of the set {0, 1, 2, . . . , to — 1} that are co-prime to 
TO forms a multiplicative group Z^. (If to is prime, then the 
set {0, 1, . . . , TO — 1} form a Galois field and all the non-zero 
elements in this set form a multiplicative group.) Let a and 
b be two non-zero elements in this multiplicative group with 
multiplicative orders o{a) — k and o{b) — j, respectively. 
For j < k, we form the following j x k matrix P with 



elements from Z*^ that has as its {s,t)th element Pg.t — b'^a* 
as follows: 
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Let P' be any j x j submatrix of P. Let Q m be the complete 
bipartite graph Kjj on j variable nodes {uq, i^i , • ■ • , '^j-i } and 



TO — 1} to the set of permu- 
i.e., set of permutations on 



j check nodes {ro, ri, . . . , Vj^i}. Let /(•) denote a function 
mapping the elements in {0, 1, . . 
tations in the symmetric group S", 
TO elements. Specifically, we let f{x) denote the permutation 
that maps i x+i mod to, for i = 0, 1, . . . , to— 1. We assign 
the permutation f{P'g i) for the edge (rg, Vt) in Qm and lift the 
graph along with their permutation labeled edges by a degree 
TO lift. We choose three disjoint subsets 81^82, and T of the 
set of check nodes {rg, ri, . . . , Vj^i} and obtain the induced 
graphs Qi, Q2, and Q, as described in Section 3. The resulting 
derived (lifted) graph Qm also yields the lifted graphs Qi, Q2 
and Q and the corresponding parity-check matrices Hi,H2, 
and H of the nested code. In particular, the matrix M is the all- 
ones matrix of size j x j. The corresponding incidence matrix 
M for the lifted graph Qm is a matrix that is a j x j array of 
shifted identity matrices, with the shifts corresponding to the 
entries in the matrix P' . For example, if the first j columns 
and j rows of P form the matrix P', then 



h 



1 2. 



where denotes the mxm identity matrix cyclically shifted 
to the left by x positions. In a more general array construction 
in [8l, the shifts in the above construction are chosen randomly 
from the set {0, 1, . . . , to — 1}. 

The base graph Qm may be viewed as a permutation 
voltage graph, and its TO-degree lift Qm as a permutation 
derived graph, where the local voltage group consists of the 
permutations that map i 1— > x + i mod to, for i = 0,...,TO — 1, 
where x can take values in {0, 1, . . . , to — 1}. 

The constructed codes are quasi-cyclic and thus have an 
encoding complexity of 0(1) per symbol |l7i. The codes have 
performance comparable to random LDPC codes for short to 
moderate blocklengths. However, at large block lengths, the 
random codes are expected to outperform this construction as 
the distance and girth of these codes are limited. Specifically, 
whenever there is a ^^2,3 subgraph in the base graph, the girth 
of the lifted nested codes is at most 12, and the distance is 
hmited by (j ' + 1)! for a column weight j parity-check matrix 
191 , ifTSl , ifTSl . These limitations motivate the use of non- 
commuting voltages in the construction in the next section 
to help surpass these girth and distance limitations. 



V. Lifted nested codes using noncommuting 

PERMUTATIONS 

In our second construction we combine the algebraic con- 
struction of LDPC codes presented in lfT2l with the lifting 
technique described in Section 3 to obtain a family of nested 
codes from lifts using nonabelian voltage groups. When the 
permutations assigned are pairwise non-commuting and meet 
the cycle structure and connectivity requirements as outlined 
in IIT2I . the derived graphs for the nested code and its subcodes 
are connected and have improved girth and distance even when 
the base graph contains a ^^2,3 subgraph. 

For an edge e, let e~ and e+ denote the negative and 
positive orientations, respectively, of e. A walk in the ordinary 
or permutation voltage graph Q may be represented by the 
sequence of oriented edges in the order they are traversed, e.g. 
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. . ej^" where each ct^ is + or — and ei, 



W 

are edges in Q. In this setting, the net voltage of the walk W is 
defined as the voltage group product a{e1^)a{e2'^) . . . a{e'^") 
of the voltages on the edges of W in the order and direction 
of the walk. We now have the following theorem ifTSll . 

Theorem 2. Let C be a k-cycle in the base graph of a permu- 
tation voltage graph with net voltage tt, and let (ci, C2, . . • , c„) 
be the cycle structure of tt. Then the pre-image of C in the 
derived graph has Ci + C2 + ■ ■ • + c„ components, including, 
for each j = 1, . . . , n, exactly Cj kj -cycles. □ 

Here we distinguish between a fc-cycle in a graph which is 
a closed walk of length k, and a cycle of a permutation which 
is a closed set of numbers in the cycle representation of the 
permutation. The cycle structure of a permutation in Sn is a 
vector (ci, . . . , c„) where Cj denotes the number of j-cycles 
in the cycle decomposition of the permutation. 

We choose permutation voltages that do not have fixed 
points, and in fact, do not contain cycles of length < 3. This 
allows our construction to surpass the girth 12 restriction that 
exists in the abelian case, provided that there are no short 
products of these voltages that yield permutations with cycles 
of size < 3 in their decomposition. We also choose a voltage 
group where the only group element with fixed points is the 
identity permutation. This eliminates fixed points in the net 
voltages of all graph cycles that do not have the identity 
permutation as a net voltage. Moreover, G has just one orbit 
when acting on {1,2,..., m} so we will assign permutations 
to the base graph that generate G to meet the connectivity 
condition |12|. 

We adapt the approach from lfT2l to determine the permu- 
tation voltage assignment to the edges of Qm. We choose 
m = pq such that p and q are prime, q < p, and q\{p — 1). We 
construct the nonabelian group G of order m = pq generated 
by elements c and d such that the order of c is p, the order of d 
is q, and dc — c^d, where s ^ l(mod p) and s'' = l(mod p). 
Further, we construct the permutation group isomorphic to G 
to use as our permutation voltage group, which we will also 
denote by G. 

We form the following j x fc matrix P with j < k and entries 
in G as follow. All the entries on 0th row and the 0th column 



of P are assigned the identity permutation. The 0th row and 
0th column of P correspond to a spanning tree in the base 
graph Kj^k- The group G has one subgroup of order p of the 
form {l,c,c^, . . . ,cf^^} and p subgroups of order q of the 
form {l,cX(c*d)^...,(c'd)'^-l}, for i = 0,l,...,p - 1. 
For the remaining entries in P, we assign non-identity per- 
mutations, that are mostly chosen from distinct subgroups of 
G. If (j — l)(fc — 1) < p + 1, (or in general, the number 
of edges outside the spanning tree is at most p + 1), then 
there are enough distinct subgroups from which to choose the 
permutations. Finally, we ensure that the permutations chosen 
in P generate the group G. 

Let P' be any j x j sub-matrix of P. Then, following the 
approach in Section 4, the resulting derived (lifted) graph Qi\i 
yields the lifted graphs Qi, Q2 and Q and the corresponding 
parity-check matrices Hi,H2, and H of the nested code. In 
particular, the matrix M is the all-ones matrix of size jxj. The 
corresponding incidence matrix M for the lifted graph Q]\j is 
a matrix that is a j x j array of permutation matrices, with the 
permutations corresponding to the entries in the matrix P'. 

This construction and the one in Section 4 can be adapted 
to any base graph with j check nodes and k variable nodes, 
not just a complete base graph, by simply replacing the entries 
corresponding to no edge connections with all zero matrices. 
In this way, other degree distributions can be accommodated, 
such as in the design example in Section 6. Other spanning 
trees can be chosen for the identity permutations, accordingly. 
Furthermore, the above construction can be extended in a 
natural way even when the matrix M'^ is an j' x j matrix 
for j' < j, thereby yielding a rank deficient matrix as 
described in Proposition I. The design example in the next 
section uses such a matrix. 

VI. Design example 

We start with a base graph with 12 check nodes and 
16 variable nodes having the following check to variable 
incidence (or, base parity-check) matrix M': 



The first 10 rows correspond to the base parity-check matrix 
of the first subcode Ci and the last 10 rows correspond to the 
base parity-check matrix of the second subcode C2 and rows 
3-10 correspond to the base parity-check matrix of the global 
code C. Using the construction approaches given in Sections 4 
and 5, two groups, each of size m = 305, are chosen. As a first 
step, a 12 x 16 matrix Al'^ having all one entries is considered. 
In the first construction described in Section 4, the entries in 
Af ^ are replaced with shifted identity matrices (each having 



size ni x m) to obtain a lifted matrix A/^ of size 3660 x 4880. 
In the second construction, a non-commutative group of order 
TO = 305 is considered, and the entries in Af^ are replaced by 
TO X TO permutation matrices corresponding to the permutations 
as shown in Section 5. 

For each case, a lifted matrix M' corresponding to the 
matrix A/'"^ above is obtained by multiplying the {i,jy^ 
block of shifted identity or permutation matrix in Af^ by 
the (i, j)*'' entry in M' . The first 10 row blocks represent 
the parity check matrix of the first subcode Ci, the last 10 
row blocks represent the parity check matrix of the second 
subcode C2, and the row blocks 3-10 represent the parity- 
check matrix of the global code C. Ci and C2 have block length 
N = 4880 and code rate Ri ^ R2 = 0.375 (and thus exhibit 
a rate loss) whereas C has block length N — 4880 and code 
rate R = 0.5. The choice of M' above yields the following 
degree distributions and (exact) density evolution thresholds 
(in Eb/No) for the nested codes: a) Code C: A2 = j^,X4 — 
^1^4 = j^,P5 = |jP6 = |i and density evolution threshold 
0.914 dB, where A; (resp. pi) denotes the fraction of variable 
(resp. check) nodes of degree i, and b) codes Ci,C2- A2 = 

4_ I — 5_ \ — J_X — ^ n — — ^ n — A 

16 1^3 — iQi^i — 16 '-^5 — i6'F4 — — iQ i F6 — ig^ 

and density evolution threshold 0.688 dB. 

Simulation results on the binary-input AWGN channel using 
belief propagation decoding are presented in Fig. |2] for the 
lifted nested code given in above example. (All simulations 
were run for a maximum of 50 decoding iterations. The 
performance of C2 is almost identical to that of Ci and 
therefore not shown.) The protograph codes from this paper are 
compared with randomly designed protograph codes having 
identical block lengths, code rates, and degree distributions in 
their parity-check matrices. 
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Fig. 2. BER versus Ei,/No for the lifted nested codes with commuting and 
noncommuting permutations. 

We can observe from Fig.|2]that all subcodes perform better 
than the corresponding (overall) codes C. Further, the codes 
obtained from the nonabelian group perform better in the error 



floor regime than those from the abelian group, whereas the 
random constructions are penalized by a significant error floor 
due to the low girth of their code graphs. 

VII. Conclusions 

In this paper, an algebraic construction of graph-based 
nested codes is introduced. The method relies on a protograph 
design and a lifting technique using algebraic voltage graphs, 
and may be applied to other base graphs with other degree dis- 
tributions for improved performance. The resulting codes have 
compact description, structure that is well-suited for practical 
implementation in several applications, and a performance that 
is better than that of randomly designed codes. 
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